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MOTION SYSTEMS ROLE IN FLIGHT SIMULATORS 
FOR FLYING RAINING - 



I. INTRODUCTION 

The use of motion systems for flight simulators as part of military flying training programs has, in 
recent years, been the subject of considerable (and often heated) debate. As early as spring 1974, scholars of 
varying backgrounds within the aircraft simulation community began to question the practice of 
automatically including large, expensive, multiple degrees of freedom platform motion systems in simulator 
procurements (Ref 14, 19). They pointed out several serious deficiencies associated with ihese devices, 
including increased energy costs, facility costs, and operational maintenance costs, Incieased cost and 
complexity meant that integration of these motion systems with high fidelity, wraparound visual systems 
became a difficult and expensive task, a job which has not been successfully accomplished to date on any 
advanced simulator complex. More importantly, critics of the motion systems pointed out that currently 
available stationary training devices were highly effective and possessed considerable transfer value, while 
no known commercially afford^;ble motion system had shown a statistically significant transfer effect, let 
alone one of practical value from either the cost effectiveness or training effectiveness points of view. As a 
result, tlie USAF tactical Air Command (TAC) recently took the position of refusing to purchase platform 
motion systems as part of its A-10 and F-I6 simulator procurement actions until such systems could be 
shown to exhibit significant positive transfer. This report will review the'literature as it relates to the role of 
platform motion systems in flight simulators and wOl attempt to place that information in the perspective 
of the military flying training program. 

The issue of platform motion is regarded as a function of four primary variables in the training 
environment: motion itself, aircraft type, pilot population experience level, and training objective. 
Througliout the remainder of this report, unless otherwise noted, motion will be regarded as being 
maneuver co'rrelated and not as resulting from disturbances generated by a platform motion system. In this 
report, aircraft type refers* primarily to fixed wing aircraft and not to helicopters nor space vehicles. 
Experience level ranges from the Undergraduate Riot Trainee through combat qualified pOots, althougii the 
emphasis will be placed on the latter, as it is in the advanced skill acquisition and maintenance that the Air 
Force spends the largest portion of its training dollars. Training objective refers to the purpose of the 
simulator system in tv-aining the person Simulators range from small, inexpensive part-task trainers, to 
highly complex (and expensive) full mission simulators theoretically capable of performing any maneuver 
or task Uiat the aircraft can. Evidence on mothn ui'e comes from three areas: ground, airborne, and transfer 
^ludies. Within each of these areas, motion w:U be examined from the point of view of either 
compensatory, pursuit, or precognitive tracking. 

IF. GROUND SIMULATION STUDIES 

Ground simulation studies, hke their airborne and transfer counterparts, break roughly into three 
groups: single- and multi-axis compensatory tasks, single- and multi-axis pursuit tasks, and multi-axis 
precognitive tasks; although by far the largest .volume of research results is in tlie area of single-axis 
compensatory tracking. Dependent measures vary, depending on experimental goal, but belong in two 
classes: time domain and frequency domain. Typical time domain measures are RMS error, moment 
functions, and time on target. Effective time constant, crossover frequency, pilot and pilot/machine 
transfer functions all exemplify frequency domain measures. Tliis report will examine experimental 
information from compensatory, pursuit, and precognitive tasks. 



HI, COMPENSATORY TRACKING 



In the typical compensatory tracking situation, tlie subject is provided an error signal and possibly 
one or more of its derivatives, by way of various displays. He then tries to minimize error by manipulating 
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the available control(s). Extensive mathematical modeling of systems similar to Figure 1 has been generated 
(kef 24, 25, 39). Variations of controller characteristics and the resulting eTfect on manual control arross a 
broad band of dynamics have been examined. Compensatory tracking tasks are forcing functions of two 
major types, single sine waves and random appearing waves, although the latter are by far the most 
prevalent. In most cases, tlie input function has very low coherency, and thus tlie subject docs not have 
direct information concerning either tlie nature of the input or the characteristics of the controlled 
element. 



INPUT 

FORCING 

FUNCTION 



PILOT 



CONTROLLED 
ELEMENT 



Figure L Typical compensator> system. 

Viewing the subject as a primitive information processor, in such a tracking task, the sensory system 
that provides the most lead (or least lag) at tlie greatest resolution for tlie error signal will be the system 
viiich allows for better average contiol performance. It is in this regard that the vestibular system, with its 
generally agreed on lower stimulation thresholds (or lower reaction thresholds) (Ref 4, 8, 11, 40, 42), 
should provide improved -packing perfomiance over, say, a visual presentation alone. However, the 
literature is restricted primarily to the tradeoff between very-small-field-of-view visual presentations and 
motion effects, so that the effect of a large field-of-view has only recently been addressed (Ref 40, 43). It is 
important that the reader understand the conceptual framework that underlies the current mathematical 
models of human tracking behavior^ and why many researchers, including the author, reject its wholesale 
application to Hying training. The primary difficulty with the present theory is that its applicability is 
limited to.. dealing with control inputs of random, random-appearing, or transient nature. Unlike actual 
aircraft flight, the pilot is presented with a display that essentially contains no information. A pilot's 
capability to ''solve" a tracking problem (say a bombing run) over a series of trials and to "store if' for 
f uture reference is not addressed. Althougli leaming of a sort will occur (specifically , learning which of the 
cues best help the pilot reduce the display error), the task cannot be learned in tlie sense that a loop, 
overhead pattern, or barrf;! roll is learned. Thus, in the presence of random, random appearing, or transient 
inputs, a pilot reacts like a servosysteni because he has no alternative and not because liis behavior can be 
characterized by servosystem properties, A second major drawback in the literature is that the control 
system dynamics studied are often very dissimilar to aircraft dynamics. Much literature has been devoted to 
unstable or marginal dynamics, containing substantial negative damping ratios or higher order derivatives, 
while most aircraft have reasonable control dynamics with excellent damping characteristics. A general rule 
is that the more unstable, or higlier tlie order, a control system is, the more likely some fonn of motion 
information will be of beneHt in a compensatory tracking task: however, for typical aircraft-like dynamics 
(Ref 12), some researchers have found that in these situations motion tends more to interfere with, than to 
aid, tracking perfomiance (Ref 15, 16, 17), h is interesting to note that pilots are instructed to ignore **seat 
of the pants" (i.e., motion) stimuu in the instrument flying environment and rely solely on the instruments. 
Mathematical models of the vestibular systsni also show a poor correlation between perceived and actual 
motion, primarily due to Uie nonlinearities and adaptation phenomena associated with tlie vestibular 



M or an excellent summary of mathematical modeling of human pilot behavior, the reader is encouragai to review 
Hoferencc 25, 
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system (Ref 2, 43). It is instructive to examine one such experiment in detail. For tius\purpose, consider 
the one discussed in "Evaluation of Roll Axis Tracking as an Indicator of VestibularVSuniato Sensory 
FunLcion" (Ref 15, 16, 17). In this experiment, subjects were asked to perform a roll comV)ensatory task as 
shou-n in Figure 2. Zero mean, band-limited (to .5 rad/sec) Gaussian noise was used as the mrcing function, 
and iis standard deviation was sci to 90° of roll. Tlie subject was presented the error signal via a small 
field-of-view, inside-out visual display and additionally, when in the motion mode, tliroughVplatform roll 
motion. A side-mounted force stick was used for operator control. Figure 3 contains lire simulated 
dynamics and Figures 4 rhrougli 7 the results of the experiment, Tlie reader is asked to stud> these figures 
carefully and refer to the original experiment lor further information if-required. 
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Figure 2, Rol) axis tracking simulator block diagram. 
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Figure 5. RMS error scores for plant number ' 



8 • 

10 



IHPUT BA^HOWlOfM- 0.5 RAD/SEC 



^ MOTIOM 
}f STATIC 



■1' 



5 10 1 5 20 25 30 ^35 40 ^5 50 
DA^f NUMBER f 

Figure 6. RMS error scores for plant number 3. 
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Before considering the data, note tJiat the approximate roll rate to aileron displacement rransfer 
funclion is a simple Rrst-order lag (Ref 11). When this is placed in the context of the experiment, wherein 
the error angle is denoted the resulting roll mode transfer function is.as shown in Figure 8. Typical values 
t'or the aircraft time constant, tau, are sliown in Figure 9. 



as) = K 




I'igurc S. Approximate roll mcxle transfer function. 

T-37 A-IO F-IB- 
.I5-I.0sec. .5-I.Osec. .4-.75sec 

.7 

Figure 9. Typical roll mode time constants. 

In this experiment, plants one and two contained an. additional (s) in the denominator, forcing the 
^subjects to generate even more lead than would be required if tlie dynamics had been representative of an 
actual aircraft. Tliis situation is confounded furtlier in plants 3 and 4, where the controlled dynamics no 
longer represent.a typical aircraft. On the basis of these data, tlie more similar to actual aircraft cynaniics 
the plant is, the more the static display performance would improve relative to the motion display 
performance. Tlie authors of Reference 16 attributed the relatively poor motion effect in plants one and 
two to "^the disruptive effect of the motion on die subject controllers. Two other facts need to be 
mentioned. First, the input forcing function was incoherent and tlius, except ^or its .magnitude and band^ 
limited nature, was unusable as an information source to the subject. Second, unlike the visual information 
available in actual flight, the visual error display in this study wac a small -field-of-view bar-line system which 
could not generate the additional peripheral visual cues for detecting and predicting motion. Tlie utility of 
these peripheral visiial cues would be expected to increase, relative to motion cues. Later in this report, two 
inlliglit compensatory tracking experiments wliich confirin these.assessments will be examined. 

Tlie study just examined is consistent with a large volume of research on single- and multiple-axis 
compensatory tracking tasks. For example, in "An Expemuental Investigation of the Role of Motion in 
Ground-Based Trainers" (Ref 23), a contracted rosea rch^Affort conducted for the Navy, published in 1974, 
tlie authors found no effect on the criterion task as a function of motion condition (off, correlated low'and 
high bandwidth motion,,^ and random, uncorrclated- motion), whereas exceptionally strong subject- 
differenced (both in, terms of individual strategies for aircraft control and ability to perform the task) were 
noted. Additionally, the authors found no difference between tKe*effect (either on the criterion task or 
pilot output measures) of limited bandwidth (correlated) motion and wide bandwidth (correlated) motion.' 
'*TTius, the more responsive platform adds nothing in terms of pilot performance, nor does it differ with 

v.. 
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rcs{>cct to pilot's ratings" (Kef 23). This latter conclusion is siill the subject of considerable controversy 
within the simulation community. As experiments involving manual tracking behavior an^^ platform motion 
effectiveness moved away froni the oscilloscope and side-arm controller displays of ^h' :;.Doratory and into 
cockpit trainers, investigators became aware of oilier, powerful variables -^na sources of information 
involved. 'Fliese are summarized in Figure 10- 



♦ Subject Differences, usually the largest single factor; Includes the 
effect of learning and experience. 

* , Trial Effects, an extremely large effect on the order of magnitude of 

the-subject effect, depending on the experience leve^ of the subject 
population. 

♦ Information source effects including: 

Control loading effects 
G-Seat effects 
G-Suit effects 
Instrument effects 
Pldtform mot ion effects 
Visual system effects 

• Task variables, including information processing requirements and 
motor dl f f iculty. • . . 



. ' * Aircraft dynamic response characteristics. 

V Figure fO. Experimental variables involved in a typical simulatoi- or transfer study, 

l*ffect siAc (Ref 18), as well as statistical significance, now plays a major rcle in determining whether 
a particular Ariable or cueing mechanise i will result in significant training transfer. However, the 
examination of motion effect size is difficult because of tlie controversy surrounding differing~motion 
platform engineering characteristics.- In these cases, althouj^I-. motion shows itself to be a very small effect, 
critics provide as an alternative explanatio.i the possibility that the observed effect size is due to each 
particular motion system's characteristics. Altliougli possessing a two -axis joystick (force type) controller, 
ratlier than a standard aircraft stick or yoke controller, and a small-fieldof-view visual display, the NASA 
LANG LEY VisuahMotion Simulator (VMS) has the best (proven) overall motion servo characteristics 
known to the author (Ref 32). For that reason, data taken from the NASA-LANGLEY VMS have been 
selected for examination here. The VMS is a 60-inch^ system ^Figure 11) which currently represents the - 
upper limit < commercial affordability. Data from three studies will be examined here: "Evaluation of a~ 
Linear; Washt) * for Simulator Motion Cue Presentajion During Landing Approach" (Ref 34);*'C6mparison 



' A "60-ini:h" system is one in whicli the nuiximum hydraulic cylinder extension is 60 inches. For a discussion of the 
cnpinccrinp limitatii>ns ji^sucialed with 6()-inch systems see Reference 6. 
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The first two studies use a common experimental design, but differ in terms of tlie type of motion 
presented. The first experiment examined the effect on pilot criterion performance, (as measured by both 
subjective and objective measures) of a five-degrees-of-freedom (heave deleted), linear washout programmed 
motion system. *The task was an ILS [instrument-Ianding-system] landing in a simulated Boeing 737 which 
consisted of: (a) a transition to the localizer beam, followed by (b) a transition to the glide slope, and (c) 
the ensuing approach to about 76m (250 ft). Three approach conditions were provided: the standard 
approach previously described, the standard approach with instantaneous encounter of a weather front (a 
10 knot crosswind with moderate turbulence), and the standard approach with the occurrence of an engine 
failure. Instrumentation consisted of an attitude-direction indicator, vertical-speed indicator, a 
liori/ontal-situation indicator, altimeter, airspeed indicator (both calibrated and true), meters for angles of 
attack and sideslip, and a turn and bank indicator" (Ref 34). Insofar as criterion performance is concerned, 
the only meaningful effects are pilots (subjects), approaches (tasks), and their interaction. Tlie analysis of 
variance table in I'igure 12 summarizes the results of that experiment. 
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Figure 72. Computed F-distribution values for the analyses of variance. 



Hie second experiment (Ref 33): had nearly identical results to the first; although an improved, 
nonlinear motion drive algorithm was used. In the words of 'the authors, "Objective and subjective data 
gathered in..t]ie process of comparing a linear and a nonlinear washout for motion simulators reyeal that 
there is no difference in the pilot-performance measurements used during instrument-landing-system (ILS) 
approaches with a Boeing 737 conventional takie<>ff and landing (CTOL) airplane between fixed-base, 
linear-washout, and nonlinear-washout operations.''^ The priniary result, tliat of a negligible effect of 
platform motion on task criterion Variables, is consistent with data taken from Navy (Ref 23) and Air Force 
studies (Ref 22) as well. Motion effect size, defined as 17* , o;^ . or pi (as appropriate) (Ref 1 8) and rouglily 
c(|uiv;ilcnt to the percentage of variance accounted for by a given treatment, is also consistent across studies 
conducted on other simulators. As far as motion effect on criterion variables is concerned, whenever three 
or niore of the categories previously listed (Figure 10) are present, that effect size is very small. 

The next e\pQ:f.iment was a pursuit tracking task. Like tlie first two experiments, thi;* one was 
conducted on the NASA LANGLl-Y ,VMS (Figure 13). Primary experimental elements of the task were as' 
follows: (See l-iuures 14 through 17,) .^ 
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1. Subject controlled vertical and horizontal separation with a target aircraft throiigli a HngertHp 
controller. Longitudinal separation was fixed by tiie computer. 

2. A secondary tap-rate task was employed to increase workload level. (See Figure 16.) 

3. Due to the relatively small motion excursions involved, platform motiorfwas, except in heave, of 
extremely higli fidelity. "Tlie pitch motion was small enougii so tliat neither washout nor scaling was 
required'' (Page 7, Ref 26). 

4. Tlie aircraft handling qualities and target frequency effects, as well as the time delays, were 
manipulated to both the visual and motion systems. 

' 5. Instruments and throttles were disconnected for the experiment. 

6. Precbgnitive tracking was ruled out by appropriate selection of target frequency. Thus, the 
subject was dependent, information provided by the displays. '' . ■ 

7. Most of the expcn ntal results are based on one subject (Subject "A," as referred to by the 

authors.) ' . 

{ . 

The primary purpose of this experimen t was to examine the effects of motion and pure time delay on 
both RMS tracking and RMS control performance. As can be seen from Figure 18, the relative motion 
contribution to the overall analysis of variance Is very small, sven thougli this experiment has an extremely 
limited number of influencing variables such as miglit be found in a transfer of-training context. This effect 
is a general one. For the instrument, tasks that the author examined, motion effect size was rarely greater 
than 10%: in the visual studies examined, \c:^ than 5%^and often smaller. One effect was consistent,' 
however, and that was the trend toward using smaller control inputs under the niotion condition than with 
the fixed base operation. Since this effect is relatively repeatable across simulation devices for most tasks, 
the important question becomes: How large is this effect and what is its likely impact on training? To 
'answer this question, consider the data of subject A, who was the viost sensitive to platform motion. 

First, with respect to criterion'performance, subject "A" is considerably more sensitive to aircraft 
type, target frequency (task), and time delay effects than to the presence or absence of motion. For 

example, consider the suminsry cf Airplanp-Motipn-Delay effects for subject '*A'' given in Figure 19. 

■ > 

It is apparent that even for a "sensitive'' subject in an experiment- designed primarily to examine 
motion effects, motion has only a very limited effect on the subject. Changes in control behavior as 
measured by changes in RMS control input are, however, noticeable. The elevator and aileron deflection 
data from Reference 22 are shown in Figures 20 and 21. 

It can be seen from these figures that the maximum mean criterion RMS difference across all 
conditions (including up to 400 ms lag) is>3.695 units (each unit is .01 radian) or 2.1 17 degrees RMS. 
Similarly^ a difference of .501 degree RMS exists for the elevator deflections. If the motion and visual 
systems were botli calibrated for a "zero" time delay condition, mean differences shrink to .583 degree 
RMS aileron and .267 degree RMS elevator (across both aircraft conditions). Referring to the force versus 
^.displacement chart (Figure 17). it can be seen that elevator force and position differentials (a few 
hundredths of an inch) arp. not discriminable to the human being, while the aileron force (estimated from 
the diagram to be about 25 lb/radian) would differ only a few_Dunces in control pressure! Here is a classic 
case -wherein >tlie power of the statistical tests and the resolution of the data can isolate the existence of an 
effect which, when taken from thr larger view nf trniniag^pilot,-4&-ol^n0-€Qnacquence whatever. It is 
important fpr thj reader to realize that even if a 'statistically detectable difference in control strategy;^ 
existed (in fact, even if that effect were large), there is no evidence at present to conclude that any one 
strategy is "better'' than any other strategy, given comparable RMS criterion scores. Tliese differences 
simply represent different ways of solving the tracking problem. The more sopliisticated the task, the larger 

the class o{.acceptable stralcgics, and the less likely a detected difference has any interprctable meaning. 

. , . , „ - ... --^ .... . ^ ^ , ^ 
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Figure 18. Analysis of variance for four pilots. (This figure shows the analysis of variance 
and omega square calculations for the motion, pilot, and time delay factors in a pursuit 
tiacking task study conducted on the NASA-Langley Visual-Motion Simulator (VMS) 
(Ref 26). Although the motibn effect is statistically significant at the .05 level, its relative » 
effect size is very small.) 
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Figure 19. Summary of data for aiq)lane-motion-delay interaction with subject A. (t-tests 
performed treating each factor separately) (This figure, adapted from reference 26, shows 
the relative effect size platform motion has on the RMS total error performance of a 
subject "sensitive" to platform motion as a function of both aircraft type and^time delay. 
Of special importance are the mean differences between the basic aircraft, with and 
without motion, at zero time delay, and the "good airplane,!' with and without .motion, 
again at zero time delay, (that is, with motion, aerodynamic and visual information 
approximately syncronized). In the case of the basic aircraft, a difference of only 371 
meter error RMS total exists between the full and motion cases. Likewise, for a "good'" 
aircraft, this difference dwindles to-;102 meter. Differences of this magnitude are of little 
consequence in a training situation, as they are dwarfed by other, more powerful 
variables. 
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[•l^4re 20, Aileron data for subject A. (This figure shows the effect of platform motion 
on joystick aileron commands for a motion seiwitive subject in a puisult tracking^ task 
conducted on the NASA Lan^ey Visual-Motion Simulator. Although the motion effect is 
statistically significant, with a relatively large omega square,, the actual joystick/ RMS 
movement ranges from .01501 radian (about .86 degree) to .02518 radian (about 1.44 
degrees) for the zero time delay (motion, visual, and aerodynamic systems synchronized) 
case. The total workload effect, or resulting effect on training of difference tfiis small is 
negligible. 
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Figure 21. Elevator data for subject A, (This figure shows the effeci of platform motion 
on joystick elevator commands for a motion sensitive subject in a pursuit tracking task 
conducted on the NASA Langley Visual^Motion Simulator. Although the motion effect is 
statistically significant, with a relatively large omega square, the actual joystick RMS 
movement ranges from .00436 radian;(about .25 degree) to .00902 radian (about .52 
degree) for the zero time delay (motion, visual, and aerodynamic systems synchronized) 
case. The total workload teffect, or resulting effect on training of a difference this small, is 
negligible. 
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IV. AmCRAI'TSTUDII-S 



Of all iHeexpcriitientaliDn relative to motion cuing performed to date. infliglit e^ixjriMcntation is the 
least well developed, however, one of the striking differences between inHiglU and many previous 
laboratory and simulator results is the profound difference between visual and instrument flight control 
behavior. These differences are char:>cterized by higher gain and less phase lag across the lliglit control 
frequency range ( Rcf 29, 41)/ The gain difference between contact and instrument night is a little over 10 
dlJ in the mid frequency regime, with lO"" or greater phase lead (contact, relative to instrument, night), 
lliese same studies show very little difference between fixed base (instrument) behavior and actual aircraft* 
behavior for experienced pilots on compensatory tracking tasks. Several authors iiave 'attributed the 
increased power of the visual effect to two contributory factors: 

1 . The high resolution of "real" visual information, together with peripheral cues. 

2, Tlie capability of tlie experienced human operator to . generate higlily complex, organized 
sequences of control actions based on partially complete information patterns. 

. . Kuehnel (Ref 20) found that experiencedjMlots couid detect changes in pitch disturbance and initiate 
.correcting responses faster than would be expected from vestibular sensing alone. The reaction time given 
for pitch was everywhere below tliat expected from laboratory data for roll and yaw'. Figure 22, adapted 
from Newell (Ref 29), summarizes this Information. In his review; Newell (Ref 29) concludes 'that' it is 
superior visuabmotion discrimination which accounts for the decreased latency; 

. In vununary. it appears that visual scnsiiij: can be of finer resolution tlian vestibular or tactile sensinij and tliat 
It can operate tor small motion perception without phase lag or time delays up to a frequency ofn.4 cps and 
; with sinall phase laj: but nu great loss of information up to a fraiuency of K6 cps. 

Whatever the explanation for these data, it is clear that a motion sense more refined than vestibular sensing, 
u.: ifis presently understood is at work. Since this information will always be available lor use to the pilot in 
the aircraft whether or not he is trained on a simulator that employs piatfomi motion, the utility of such a 
I'lattorm motion systctn appears marginal. ' • . 




ANGULAR ; ACCELERATION ^ DEG/SEC* 

Figure J2. Latency and reaction time versus angular aecelerntion. 

One of the difficulties remaining with infiiglit experimentation deals, with problems in the 
computation of human transfer functions. Often insufficient power exits at the high end of the forcing 
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function spectrum to permit a neaningful analysis of motion/no motion effects. In other cases, instrument 
lag (or resolution) makes comparison difficult. 

The next study was an inflight simulation study conducted at the NASA Fliglit Research Center to 
detemiine roll-mode simulation motion requirement!, (Ref 41). Wliite noise was passed through two 
seco.nd-order filters and used to create separate error command runs. Tliree values of roll-mode time 
constants were selected, to provide a range of aircraft performance from fighter to transport. Figure 23 
shows the forcing function input function, and the results of the experiment for each of the roll-mode time 
constants. In this instance, in excess of 99% of the total input pov/ei is below 4 rad/sec. In ihls region, not 
only is visual performance considerably better than either fixed base or instrument flight (with actual 
aircraft motion), but fixeb base performance is better than moving base, as measured by higher gain and 
lower phase lag over the midland low frequency regimes! Considering the number of data runs made, 
comparison beyond frequencies of 2 to 3 rad/sec is not meaningful. (For a discussion 6f error analysis 
involving transfer function estimation see Bendat and Piersol (Ref 3) or Otnes and Enochson (Ref 3\)\, 
Therefore, for experienced pilots on compe^nsatory tasks, the case for motion is extremely weak. Even full 
fidelity "tactu^J aircraft}' mo tiorf differs scarcely from fixed base operation. With such a minor differential^ 
for full fidelity motion, a platform motio^i system, with its numerous known deficj^cies (Ref 6), canndt 
be expected to provide a sighificant transfer-of-traihing effect. jf 

The subject of Flying Training transfer is an .area which, by research! standards, has been only 
modestly developed, but from an experience viewpoint it is voluminous. Every aincraft to aircraft, simulator 
to aircraftroY training course to aire raft is considered as a data point for transfi&tt<Fhus, the questions arise; 
Are^ platrorm motion systems necessary for training? If not, what is the'trainirfg effectiveness of their less 
costly alternatives? Fortunately^ in this area, the data are not at all. ambiguous: For example, at the Flying 
Training Division of the Air Torce Human^^Resources ^ Laboratory (AFHRL/FT), almost all possible 
maneuvers tmd tasks for Instrument, Navigation;. Formation, Contact, Air-to-Air, and Air-to-Surface flight, 
have been examined, and as^et not a single*&ne h?s been found that is not trainable without a platform 
motion systbm. * 

Certainly from the evidence available' it can be deduced that platfomi motion is not necessary to 
produce successful training transfer for most tasks. ^At t"he same time, while the present evidence does not 
show platform motion to be valuable as an enhancement to training, neither has it been sho^yn to be a 
detriment. Many proponents of motion systems, includfng ^ome simulator indt^stry spokesmen, feel that 
' with "increased empha^.is on motion research and development, the proper software and hardware 
combination will be f6und to produce a . platform motiqn system capable of significant, economical, 
differential training transfer. Once a system is developed which, investigators believe will produce the 
desired training transfer, it can.be tested in actual transfer experiments. Lo^cally» this line of reasoning 
leads to a procurement and research strategy which defws large scale j^urchases of platform motion. systems 
while research continues into "Optimizing C.eir use. Thus valuable "^defense dollars will not be spent on 
equipTrfent unlikely to produce any increase in defense'posture. At the same time, the oi3tion is left open to 
include iniproved motion platform systems, -if they can be made significantly beneficial, at a later date. 
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Figure 2S. Man machine transfer functions and disturbance input power spectnim 
for NASA in-fliglit simulation experiment, 
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V. TRANSFER OF TRAINING STUDIES 



Ultimately, each training system must be evaluated in the operational context. Transfer of training 
studies are designed fpr this purpose. Each of the two studies presented in this section were chosen 
specifically to represent two distinct flyin^.problems. Tlie first, formation fliglit, is a precision flying task 
which is essentially pursuit in iiature. The second task,. air-to-surface weapons delivery, is primarily a 
cognitive task with a compensatory component. Although the.latter experimental study included platform 
motion as a variable,-the^ emphasis in this section is not on the value of a particular platform motion system, 
, but on the.training effectiveness of their alternatives. 

Tlie Formation . Flight Trainer (FFT) was procured'to examine the effectiveness of a low fidehty, 
formation flight, part-task trainer (see Figure 24), The system consisted of a low resolution, 
wide-field-of-view visual system, simplified cockpit, and'primitive (constant spring) control loading system. 
(See Refs 37 and 38 for additional informatiori.) Nine maneuvers were taught in accordance with Air 
Training Command (ATC) procedures and evaluated by ATC check pUots on an expanded 12-point scale. 
The maneuvers were: stjaiglit-and-leyel, shallow bank turns (15° to 20°), medium bank turns (30° to 40°), 
steep turns (60° to 90°), route, crossunder, echelon turns (45° bank), turning rejoin, and straight«ahead 
rejoin. Two separate studies were. conducted with a combined N of 11 1. Both studies provided conclusive 
evidence that the trainer is an effective device, significant beyond p = .05.^- This was true in spite of the fact 
that few, if any,, of the critical engineering parameters (such as control stick gain, aircraft transfer function, 
etc.) resembled their physical counterparts. What did remain constaht were the Cognitive and decision 
making components. It is a well known and important characteristic of transfer.that the most generalizable 
elements of a task are those that most affect transfer. In this case,' it is apparent that control form 
invariance is sufficient for teaching forniation flight. As was observed before, platform motion is not 
essential to produce rapid, effective, economical training. 




' Figure 24. Formadon flight trainer. \ 



An u?' was calculated for each experiment, and ranged from 16% for experienced subjects to 397o for inexperienced 
subjects (that is, the device was more effective in enhancing the training of inexperienced subjects). This effect is a typicaf 
one: moreover, the higher the experience level and the more familiarity with a given task a subject has, the< lower the 
expected u>^ will be. . • ' ^ ' 



^lie next study (Ref 10) examined a more general transfer effect, that, of air-to-surface weapons 
delivery training. In this c\. criment, 24 undergraduate pilot training graduates were intercepted just prior 
to F-5B fighter lead-in tr^.iiing ;ind given instruction (eight l-hoor sorties) in air-to-surface weapons deliver}^ 
techniques in the Advanced Simulator for Pilot Training (ASPT). The ASPT, a full mission simulator with 
wraparound computer generated visual capability located at Williams AFB, Arizona, was configured as a 
T-37. not an an for this study. After training, each group dropped ordnance from the F-5B on the Air 
Force Gila Bend Gunnery Range. The resulting distributional differences between the simulator trained 
groups and the control group were visually distinct. 

Bear in mind, thjs was the first F-5B aircraft sortie ever flown by these subjects. Their error scores 
and range performance were representative of graduates-of-Gom bat-Grew Training-SGhool^it4i-<;onsiderable 
range experience. There were no motion effects (positive or negative) of any kind. At this f>oint, it is 
important to consider the'training ramifications of this experiment. First, from the fidelity viewf)oint^ very 
few of the critical simulation engineering parameters are similar to their aircraft counterparts. The control 
dynamics are unrealistic, the range pattern and airspeeds were mucii slower in the simulator than in the 
actual aircraft, and the instruments, mil-settings, in fact, even the basic shape of the lift/drag curves are 
dissimilar. Yet, in spite of these differences, transfer was exceptionally higli. Again, what is "simflar" is 
what matters the most: the cognitive components, for precisely the same reasons, namely, that they are 
invariant under the translation from sin^ulator task to aircraft task. Teaching '"judgement," oY more 
precisely the building a strategy of Hying based on experience, is the critical problem. 

Air-to-surface training and experimentation have now been extended to A-IO transition and 
air-to-surface research, using a simplified A-10 flight model developed at AFHRL/FT. Both phases of 
training (througli two classes) have been extremely successful. In some cases, the novice pilots transitioning 
to the A-10 have actually outperformed their instructor pilots in terms of bomb scores on the Air Force 
Gila Bend Gunnery Range (dropping practice bombs from the A-10 aircraft). For the A-10 study (being 
conducted for TAG), platform motioa is not used. Instead, motion cues are supplied by a G-seat system 
and, to a large degree, by- the wraparound visual system. The effect on withih-simiilator performance of 
experienced pilots of the visual field-of-view is exponential (see Figure 25). 
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Figure 25. Field-of-view effect on simulator bomb deliveries. 
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It would be misleading to imply that stiong visual effects apply only to experienced pilots. In the first 
of a series of contact flight studies conducted on ASPT, eight novice subjects were taught basic aircraft 
control in the simulator including takeoff, straight-in approach and landing, 360** overhead pattern and 
landing, configuration change, tums to heading, and airspeed controL Subjects were advanced on a 
proficiency basis in the simulator. Of the eight subjectsi'seven were successful irr landing the aircraft on 
their first aircraft sortie (the test pight for this experiment). The very fact that the instructor pilots-felt 
confident enougli about tlie student's ability to allow the student to complete the landing is indicative of 
the, training value of the simulator. The wide-field-of-view visual display is a key element here because an 
overhead pattern simply cannot be practiced without one. 



VI. ANALYSIS f * 

, . ( 

' In reviewing tlie data relative to platform motion and flying training for fixed wing aircraft, several 

salient points arise. The earlier experiments were small -sample compensatory or i pursuit tracking tasks 

wherein thf^ operator was asked to nullify the effect of an incoherent signal forcing function, displayed 

visually on an oscilloscope or similar device. The typical control dynamics were not generally representative 

of operational aircraft, often having substantial'negative dariiving ratios or an extraordinarily high number 

of poles in the denominator of the control element transfer function. Subjec.rgopulation and controller 

characteristics were also dissimilar to the operational environment. In subsequent simulator experiments, as 

well as in later transfer experiments the addition of platform motion'had little, if any, noticeable effect on 

criterion- performance in standard aircraft flying tasks; operator output behavior, however, was affected, 

although that effect was seen to be small in absolute terms. Other variables were demonstrated to have an 

equal or more prpfound effect on training (effect size) than the presence or absence of platform motion. 

These include individual subject differences, (e.g., experience and ability), practice effects, task variabiles, 

aircraft and control loading response characteristics, and other information sources;most particularly high 

resolution, wide-field-of-view visual systems, G-seats, G-suits, buffe^t and vibration systems, and aircraft 

instrumentation. Of critical importance, and independent of any controversy surrounding -the engineering 

limitations of specific platform motion systems, is the fact tliat almost all .contact, formation, navigation, 

instrument, air-to-air, and air-to-surface tasks can be taught quickly, efficiently (and economically) without 

employing a platform motion system. It is asserted that this is a consequence of the fundamentally 

cognitive nature of flying (Ref 9) and the development through 'experience of open-loop, hierarchical 

control over motor behavior. 

As a final note, tlie logical place to teach proper use of motion cues is not in a simulator, but in the 
aircraft. The cues delivered by the present (and foreseeable) platform motion systems differ radically in 
both time and frequency domain characteristics from their aircraft counterparts, except in the case of 
buffet and, vibration cues. Thus, wliile a platform motion system miglit conceivably aid performance in the 
simulator, prospects for increased transfer to the aircraft are small. Buffet and vibration cues (often tet;med 
**alerting'' cues) can be generated without resort to a platform motion system through some less expensive 
alternative. Tliis is not the -case in some very important emergency situations, such as engine-out on takeoff 
for a wide bodied aircraft. A study conducted on the Flight Simulator for Advanced Aircraft demonstrated 
the positive value of such cues (Ref 7). While it is not known if this simulator practice would transfer to the 
aircraft, it is certainly hazardous, as well as unwise, to practice the maneuver in the aircraft. 

V». RECOMMENDATIONS 

Only two recommendations regarding hardware procurements can be made as tlie result of this " 
report: . ^ - ^ 

I. Wherever feasible and #affordable, simulator systems should be procured with the largest 
field-of-view visual system that is consistent with mission requirements. Because a platform motion system 



hxs a considerable impact on visual system design alternative.s and tliesc will eventubily affect training 
effectiveness, platform motion should be carefully scrutinized prior to its inclusion. 

2. Until research can develop a significantly improved platform motion system (one capable of 
enhancing training) simulators may safely be procured without a platform motion system, (without 
compromising training effectiveness). Naturally, the option to buy a platform motion system can always be 
held open at some cost. 

Since the early 1950's, considerable research efforts have been spent on analyzing compensatory and 
pursuit-trucking fasks. The result has been a collection of descriptive mathernatical nToders~which can, on a 
trial-to-trial and.^ pilot -to -pilot basis, be made to fit observed data. The mathematical models, treat the 
human* pilot essentially as a passive servo-system, while ignoring his cognitive and decision making 
processes. Attempts to model skilled, open-loop monitoring behavior is unfortunately limited at present to 
general block! diagrams. Some excellent wock has occurred in the area of cognitive sets and workload 
estimation using maximum likeHhood estimators f itef 5). Tliis work should be continued and extended. 

It has long been known that hunian controllers can and do develop hierarchical^ control over skills 
even in ''unsolvable" lasks (Ref 35, 36). Invariably, this skill acquisition results in behavior that is superior 
to a strictly error-feedback strategy, giving the impression that the human operator is processing 
information at a higher rate than would be expected on tlie basis of even continuous feedback alone, lot 
iilone time-sampled feedback. Reseiu"ch is required to deterniine both the mechanism for this remarkable 
behavior and the means for instilling it into pilot trainees. Periiaps someof tjie conceptual models offered 
by nonlinear information processing theory (maximum likelihood (Ref 21) or maximum entropy (Ref 13, 
28)) will point the way. Determining the pilot's cognitive and decision process is necessary to understand 
and optimize flying training. 

■ ■ ■ . .. ^ 
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